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A  two  compartment  storage  model  with 
an  underlying  semi -Markov  process 


by 


Eric  S.  Tollar 


ABSTRACT 


A  storage  model  with  an  underlying  semi -Markov  process  is  proposed  to 
model  the  behavior  of  a  two  compartment  storage  system  with  one  way  flow. 

It  is  shown  that  based  on  first  moment  assumptions,  the  divergence  or  con¬ 
vergence  of  each  compartment  is  determined.  For  the  eight  separate  cases 
in  which  at  least  one  compartment  does  not  converge,  the  bivariate  asymptotic 
behavior  of  the  compartments,  when  appropriately  normalized,  is  determined 


under  second  moment  conditions . 
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1 .  INTRODUCTION 


i 


In  this  paper,  a  two  compartment  storage  model  based  on  an  underlying 
semi-Markov  process  is  examined.  This  model  is  an  extension  of  the  popular 
single  compartment  model  considered  initially  by  Senturia  and  Puri  (1973), 
with  subsequent  research  by  Senturia  and  Puri  (1974),  Puri  and  Senturia 
(1975),  Puri  (1978),  Balagopal  (19791,  Puri  and  Woolford  (1981),  and  Puri 
and  Tollar  (1985),  among  others.  The  extension  to  a  model  with  an  arbi¬ 
trary  amount  of  compartments  based  on  an  underlying  Markov  chain  has  been 
considered  in  Tollar  (19S5a,  1985b).  For  the  sake  of  simplicity,  we  have 
reduced  the  number  of  compartments  to  two  in  this  paper.  This  retains 
the  flavor  of  the  multiple  compartment  model's  variety  and  difficulties, 
while  removing  much  of  the  intractability  of  certain  expressions  (for 
some  understanding  of  both  of  these  features,  see  Tollar  (1985a,  1985b)). 

Of  course,  all  of  the  difficulties  which  typically  arise  from  considering 
continuous  time  instead  of  discrete  time  are  still  present. 

All  of  the  random  variables  are  considered  to  be  defined  on  a  given 
underlying  probability  (0,  A,  P) .  Let  J  be  some  denumerable  set,  and 
{(Xn,  T^) ,  n  =  0,  1,  2,  ...}  a  Markov  renewal  process  with  semi -Markov 
matrix  A(t)  ■  (A^(t)) ,  (see  Cinlar  (1969),  where  for  all  i,  j  e  J,  t  a  0, 


p(V5-  T„ 


n-1 


St  |T, 


0’  O’  V  1’ 


.T 


n-1’ 


X  =  i)  -.A.  .  (t)  .  (1.1) 

n-1  :  ’  .  J.JL  ■  V 

.  *•  * 


V.'e  assume  (X^,  n  = 0,  1,  2,  . . . }  is  a  positive  recurrent,  aperiodic,  irre¬ 
ducible  Markov  chain  with  transition  matrix  P  =  (p. .)  *  (A.  .(»)),  and 

*  J 

stationary  measure  tt  =  (tk).  The  moments  of  the  sojourn  times  in  a  state 
i e  J  are  then  given  by 


-  2  - 


'•k-/otk  l  k  =  l,  2 . 

jeJ  3 


where  for  simplicity,  we  write  nu  =  ru 


With  each  i e  J,  we  associate  a  triplet  sequence 
{(Un(i),  V^(i),  wn(i))»  n  =  0,  1,  ...}  where  the  triplets  are  i.i.d.  random 


triplets,  independent  of  { (xn »  Tn)>  n  =  0,  1,  ...}  and  of 

{(Un(j)*  V^fj),  W  (j),  n  =  1 ,  ...>  for  j*i.  In  addition,  we  assume  for 

all  i  e  J  that  F.  |U.  (i)  |  <  “,  E  | (i)  |  <  «,  E  | (i)  |  <  ®, 


p(Un(i)  *  0.  Vn(i)  *  0,  Wn(i)  *  0)  =  0  V  n 


(1.2) 


P(Un(i)  <  0)  =  P(Vn(i)  <  0) =  P(Wn(i)  <  0)  =  0. 


(1.3) 


We  then  define  random  variables  Z.  and  Z-  by 

l,n  2,n  ' 

Zl  n  =  »ax(0,  Zl  n.j  ♦!)„(*„)) 

From  (1.4)  it  follows  that 


Z,  =max(Z.  +  S  .  max  (S  -S.)) 
l*n  1»°  n  i^jsn  n  y 

Z2,n  =  raax[Zl,0  +  Z2,0  +  Rn’  Zl,0+  1!J^n(Sk  +  Rn  "  V' 


(1.4) 


(1.5) 


max  (Sfc-Sj  +  Rn- V3"2!  n’ 
lsjsk<n  K  J  n  K  1,n 


where  V.^W  -V.(X.)]  and  Rn  =  ^[11.  (X.)  -K.(X.)3. 


For  details 


of  the  derivation  of  (1.5),  see  Tollar  (1985a). 

Finally,  to  introduce  continuous  time,  we  define  these  quantities  for 
an  arbitrary  time  t  by 


(Zj  (t) ,  Z2(t))  ~  (zi  M(t)  *  Z2,M(t)^’ 

where 

M(t)  = sup{n:Tn s t).  (1.7) 

Close  examination  cf  (1.4)  yields  that  (Z^t),  Z2(t))  represent  the 
amount  of  material  stored  in  the  first  and  second  compartments  of  a  two 
compartment  storage  system  with  one-way  flow.  The  sequence 
(Un(Xn),  n  =  l,  2,  ...}  represents  the  flow  of  material  into  the  first 
compartment.  The  sequence  {Vn(Xn),  n=l,  2,  ...}  represents  the  amount 
of  transfer  demanded  between  the  first  and  second  compartment.  Finally, 
{Wn(Xn),  n*l,  2,  ...}  represents  the  amount  of  output  demanded  from  the 
system,  via  the  second  compartment.  As  such  at  time  T  ,  if  U^(Xn)  >0, 
Un(Xn)  is  added  to  compartment  one.  If  Vn(Xn)  >0,  then  either  V^fX^)  is 

transferred  from  the  first  compartment  to  the  second,  or  all  the  material 
present  in  compartment  one,  whichever  is  smaller.  Finally,  if  wn(*n)  >0, 
then  we  have  an  output  of  material  via  compartment  two  of  either  Wn(Xn) 
or  all  the  material  in  compartment  two,  whichever  is  smaller.  It  should 
be  noted  that  the  assumptions  (1.2)  and  (1.3)  are  not  mathematically 


necessary,  but  based  on  the  physical  model  outlined  above.  These  assump¬ 
tions  are  made  so  that  simultaneous  transfers  and  negative  input/ transfer/ 
outputs  are  not  allowed.  The  subsequent  results  in  this  paper  are  identi¬ 
cal  with  or  without  these  assumptions. 

Finally,  we  let 

(1.8) 

(1.9) 

with  equivalent  definitions  for  E^V  and  E^W.  In  1985,  Tollar  established 

that  in  the  discrete  tine  case  the  moments  E  U,  E  V  and  E  W  determine  the 

ir  ir  n 

convergence  properties  of  the  amount  contained  in  the  compartments  as  time 
increases  to  infinity.  The  convergent  compartments  will  be  called  sub- 
critical^  while  the  divergent  ones  will  be  called  critical  or  supercritical, 
depending  upon  the  rate  of  divergence.  It  was  also  shown  that  when  the 
critical  or  supercritical  compartments  are  appropriately  normalized  they 
converge  in  distribution,  independent  of  the  subcritical  compartments. 

In  this  paper  it  will  be  shown  that  all  of  the  results  in  Tollar 
(1985a,b)  still  hold  true  in  the  continuous  time  case,  as  long  as  at 
least  one  compartment  requires  some  normalization.  Section  2  is  devoted 
to  the  four  cases  in  which  neither  compartment  is  subcritical,  while 
section  3  is  devoted  to  the  four  cases  where  exactly  one  compartment  is 
critical.  The  remaining  case,  where  both  compartments  are  subcritical, 
is  left  to  a  subsequent  paper. 


and 


B  =  T  m.m. , 
ieJ  1  1 


EirU=  I  iriE(Ui(i)), 
ieJ 


mmmwzm 


w,  y*y .y-y*  y- 


\  ;■  .v." 


2.  NEITHER  COMPARTMENT  SUBCRITICAL  . 
— - — - - -  - — . . . . . — -•* 


As  established  in  Tollar  (I965a,b),  the  values  Z^(t)  and  Z^Ct) 
diverge  as  t  approaches  infinity  if  E  U>E  V£E  V,  for  E  U,  E  V,  and  E  W 
defined  as  in  (1.9).  Depending  upon  whether  or  not  the  equality  is  strict 
there  are  four  distinct  cases  for  the  behavior  of  the  process.  It  is 
shown  that  the  limit  behavior  of  all  the  cases  can  be  represented  as  func¬ 
tionals  of  Brownian  motion  when  the  contents  are  appropriately  normalized. 

For  the  proof  in  this  and  the  subsequent  section,  the  following  defi¬ 
nitions  are  needed.  For  iQ e  J,  an  arbitrary  element,  let  us  define 

t. ,  t_,  ...  t  recursively  by  t.  =  0,  and 
l  *  n  u 


Vn'lnU>Vi;V1oK 


(2.1) 


M.  (t)=sup{n:T  <th 
0  n 


(2.2) 


Further,  let  us  define  Yv  by 

u-v  J 


r«).  V 


l  CU.Uj)  -  V.(x.)3  -  (Tt  -Tt  )e*-L(EirU-EiTV),  (2.3) 


3=ti-l+1 


and  define  and  analagously.  The  properties  of  Y^^  can  be  found 

u-w  v-w  °  J  u-v 

in  Balagopal  (1978),  but  essentially  they  are  that  {Y^n^:n=2,  3,  ...)  is 

and  i.i.d.  sequence  with  E  Y^^s  0.  Let  us  also  define  Y^^  by 

u-v  u-v 


*S”\  J  'W-W1- 


(2.4) 


-  6  - 


As  in  most  proofs  for  normalized  processes  defined  on  Markov  renewal 
processes,  we  will  show  that  the  process  at  hand  behaves  asymptotically 
like  a  fimctional  of  i.i.d.  random  variables  by  focusing  on  the  return 
times  to  the  state  i^.  The  limit  results  will  then  follow  from  the  be¬ 
havior  of  the  i.i.d.  random  variables. 

In  all  four  cases,  since  Zj(t)  and  Z2(t)  will  be  appropriately  nor¬ 
malized,  the  initial  values  Q  and  Z2  Q  are  immaterial,  and  will  be  set 
to  zero.  Then  (1.5)  reduces  to  the  simpler  form  of 


[Z  (t) ,  Z  (t)]  =  L  max  (S  m  -S.), 
1  1  0<j<M(t)  H  J  J 


max  (S.  "  +  ~  maX 

0^j<fc<M(t)  k  3  05j<M(t)  V  3  3 


(2.5) 


THEOREM  2.1.  If  E_U  >  E_V  >  E_W, 

-  -  7T  7T  TT 

°lsEC^!l)2lX0  =  i0j  °2  =  E^Yv-w)ZiX0  =  V  <0°’  then  a8  t^“>' 

P(Zj(t)  -  tff  ^U-E^V)  sx(tir.  ayl)~'K 

Z2(t)  -  te'^V-E^V)  sy(tm.  o^'WpCXSx,  Ysy) 
where  (X,Y)  ^11(0,1) ,  with 


PROOF.  From  (2.5),  it  can  be  shown  that 


zl(t)“SMrt)~  max  ("Sj) 
1  J  0<j<24(t)  3 


z2(t)  =FVm  +  max  ('VW“  max  (“S1) 

1  M(tJ  Osj<:k<M(t)  3  k  k  Osj<M(t)  3 


Since  E  U>E  V>E  W,  it  follows  from  Tollar  (1985a)  that  Jim  max  (-S.)  =Z 
*  *  **•  O^jsn  3 

where  P(Z  <®)  =  1,  and  that 


P(Ai£  max  (-S.  +  S  -  R  )  <«)  =  1, 
^  Osj<k<n  3  k  k 


Since  both  are  monotone  functions  in  n,  we  see  that 


lin  max  (-S  .)  <  »  a. s  . ,  lim  max  (-S  .  +  S,  -  R  )<®  a.s 


t-*°  Osj<M(t) 


t-»«°  0<jsk<M(t) 


j  ~k  ‘V 


As  such. 


lim  t'^CZjlt)  -SM(t)]  =  0  a.s., 


lim  t  [Z2(t)  -  (R^,^^  ”^M(t)^s^  a*s. 


SHRWJS 


It  is  well-known  (see  Puri  and  H'oolford  (1981))  that  for  sums  on 

- 1  _  1  2  V 

semi-Markov  processes,  lira  P(S..,..  -  tB~  (E  U-E  V))  <x(ttr.  g  a.)  ') 

t-*»  M(t)  Tr  7T  1 

converges  to  the  standard  normal  cumulative  distribution  function.  A 
simple  extension  to  bivariate  processes  yields  the  theorem.  □ 


THEOREM  2.2.  If  E  U  >  E_V  =  E  W,  B<»,  a?  *  EC (Y(1) ) 2 1  X„  =  i„]  <  °°,  and 

-  IT  7T  TT  1  U-V  U  U  - 


EC^v-w)2|Xo  =  iOJ<a>»  then  as  t->°° 


it  r<  irs  ^ _ f  j _  « "  ^ 


P(Zx(t)-t3  "(E^U-E^V)  ^x(t7r.^6  ap  2, 


Z~  (t)  <  y(tm.  e'1ah'i'i 
*  z 


•P(pZ2(l)  Zx(l)  <x,  sup  (Z2(t))  Sy), 


0<tsl 


where  Z^*).  Z2(‘)  are  independent  standard  Brownian  motion  processes. 


°2  *  “‘‘v-'w’2  IX0  >  i0)  •  Hi  P  =  (olP2r1Etl'lX-i'X0  '  ‘o] 


_  1/ 

PROOF.  As  in  theorem  2.1,  it  is  clear  that  lim  t  '  I  Zj  (t)  -  |  =  0 


t-*» 


From  (2.5),  it  is  clear  that 


"ax  «WW-(VV>-  ‘-*j> 


OSkSM(t) 


Osj<M(t) 


SZ2<t)  S0skS(t)((l<H(t>  ’  <R|  ’Sk))' 


% 

% 


_  .  -J* 

Since  t  max  (-S.)-+0,  we  have  that 

Osj^M(t)  3 


ii»  --*l(t/(«.,(0  -  V),  - 


(2.6) 


From  (2.2)  and  (2.3),  we  have  that 


SM(t)‘tB 


M.  (t) 


(i)  M^t) 

Yu-l\  t 


\  (t)+1 

0 


M.  (t) 

0 


)3‘1(EiTU-E7rV) 


By  appealing  to  renewal  theory,  as  in  Puri  and  Koolford  (1981),  it 
is  easily  seen  that 


lim  P(  l  [U.  (X.)  -  V. (X.)3  <  x)-*-P(x),  for  some  cumulative 

t-*»  t  + 1  1  1  11 

M.  (t)  1 

V 


distribution  function  F.  As  such. 


...  Mft) 

1  2  l  CU.(X.)  - V.(X.))-v  0. 


V  (t)-1 

0 


11  11' 


f  N  4  m~'  v-  •"  s  •  •  -  •  •  .  ■  .  •  _  <  .  *'  «  «  » 


.*  /  .*  /  V*  s  ■ 


By  a  simple  renewal  result  (see  Karlin  and  Taylor  (1P75)),  it  also 


follows  that 


As  such, 


».  P 

t  *(t  -  T  )  “-*■  0. 

\  (t) 


M.  (t) 

7  10 

t'^rz.(t)-  I  y 

1  i=2 


(i), 

u-V. 


0. 


Also, 


max 


C(Rt  -S  )-(R  -S.)3| 

nskstM  ro  V  (t)  tm  (t) 

Mi0(t)  xo  1 o 


M(t) 

*  t  IV.  (X.)  -W.(X.)|, 

V  (t)+1 

o 


and  a  similar  technique  yields  that 


j,  Mft)  P 

t'z  l  ! V.  (X.)  -  W  (X.)  !  ■—  0. 

t  +1 

M  (t) 

0 


Let 


U.  *  max  ((Rt  -  S  )  -  (R»  -  S-) 
J  tjjSCst^  j  j 


-  11  - 


It  follows  that 


max 

l<jsM  (t) 
0 


M.  (t) 

'  V 
I  1 

l  J  +  1 


v-w 


*  max  C(R  -S  )-(IL-S.)) 

05k5tM  ft')  \  Ct)  M  (t) 

Mi  (t)  X0  x0 


(2.7) 


S  |Y(1)  | 
v-w 


max 


lsjifrl  (t) 
0 


M. 

■  l 


(t) 

0 

1  1 
j+l 


,(i) 

v-w 


+  max  (U . )  • 
lsj^M  (t)  J 
0 


From  Karlin  and  Taylor  (1975),  there  is  a  net  {et:t£0}  where 
et +  0,  and  for  all  t  >  0,  letting 


£.(t)  =  Fir  B  1  -  E  )tJ, 

0 

Z( t)  =  [n.  B^t), 

X0 

IA t)  =  [(it  0-1  +  e  )t], 
0 

we  have  that 


(2.8) 


P(£.(t)  SM.  (t)  s£,(t))  >  1  -  e 
0 


(2.9) 


Ijj 


Therefore, 


IM 

r,  V 


P(  max  (U.)>et2)s  £  P(U.  >et2)+e 

lSj<M.  (t)  3  i=l  1 


(t) 

0 


=  £2(t)P(U1  *et. 


Since  El(Y^)2|X0  =  i0)  <»,  lj|n  n2P(Uj  S  en)  =  0, 


which  implies 


lim  P(  max  (U.)>et2)=0. 
t-*»  (t)  3 

*0 

Clearly  0.  Therfore,  it  follows  from  (2.6)  and  (2.7)  that 


M.  (t) 


-U  9  p 

t^E(t)-  max  (  l  '*11)1—+  °. 
lsj*M.  (t)  i=j+l 
1 0 


Clearly, 


r_Mi  Ct)  M  (t) 

l  Y(i\  max  l  Y™ 

_  i*2  U_V  lsjsM  Ct)  l  jJl  V'WJ_ 

^  r\ 


(2.10 


M.  (t) 


?  Y(i)  max  [  J  Y^ll. 

■  S  u-v’  lsjsM.  (t)  H*2  V  3 
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From  Kolmogorov's  inequality  and  (2.9)  we  have  that 


(t) 


0  ...  £(t)  ...  . 

P  ( |  l  Y(l)  -  l  Y  1  |  >et2) 

X  u-v  %  u-v  J 


IM 


If t)  .  .  1  2K  }  .  , 

^P(  max  I  f  Y^|>et*)+P(  max  I  7  Y^  I  >  et^)  *  e 
l^VijaCCt)  u'v  £(t)<js£2(t)  ^(t)  +  l  u'v 


<(£(t)  -£1(t)o^(e2t)‘,+ (.CjCt)  -^(t))a^e2t)"1  +  et. 
=  [£2(t)  -£1(t)]o2(e2t)"1  +  et. 


From  (2.8)  we  see  that 
M.  (t) 


t-w» 


Similarly, 


lim  P(|  l  Y(l)  -  {  \M\  >et%)  =0. 
X  u-v  X  u-v 


(2.11) 


•  i 

P(  I  max  (£y  W)  -  max  (M^)  |  >  et%) 


l<j<M.  (t)  2  ¥  "  l<j<£(t)  2 

*0 


<  (£(t)  -  -e^t^o^t)'1  +  (£2(t)  -  £(t))a2(e2tf 1  +  et. 


From  (2.6),  (2.10),  (2.11)  and  (2.12)  it  follows  that 


(2.12) 


•  km  ka  r  a  rji  r  #  *  J  *  > 

Si 


If 


fill 


•2» 

& 


lim  P(Z.(t)  -  tg_1(E  U-E  V)  <x(tTr  t'a2.)'2,  Z-(t)<y(t7T 

t-K»  71  If  xQ  i  ^  A0 


=  limP(  j[  Y^JixCtTT  B_1a^,  max  (  j  Y^1^)  <y(tv.  $~1a2)^) . 
t-**>  2  U  v  X0  1  Hj<£(t)  i=2  V"W  *0 


(2.13) 


[ns J  _^[nt] 

Since  (n  £  Y,  n  2  £  Y'-1J)  converges  uniformly  to  bivariate  Brownian 

2  u-v  2  v-w 

motion,  and  the  maximum  is  a  continuous  functional  on  CC0,13,  it  follows 
from  results  of  Donsker  (1951)  and  Billingsley  (1968)  that 


lim  P(TV^£x(t7r  max  (  {  y£>)  £y(t7r 

^  u  V  1Q  i  ---i  v  w  * 


t-*»  2 


l£j&C(t)  i=2 


a 

$ 


P(pZ2(l)  ♦  /l-p  Z.-(l)  ix,  sup  (Z_(t) V-Sy), 

0<t<l 


for  Z1(* )  and  Z^C*)  independent  standard  Brownian  motion,  which  from  (2.13) 


completes  the  proof.  □ 


It  should  be  noted  that  the  above  theorem  is  just  the  continuous 


time  analog  to  the  theorems  proven  in  Tollar  (1985b)  for  the  discrete 
time  case.  The  techniques  used  to  reduce  from  continuous  time  to  a  fixed 
number  of  i.i.d.  random  couplets  are  similar  to  those  used  in  the  above 
and  analogous  to  those  in  Tollar  (1985b).  As  such,  the  following  proofs 
will  be  less  detailed  in  this  reduction. 
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THEOREM 


5M  2,3.  If  E^U = E^V > E^W,  B  <  -,  Et  (Y^)2  |XQ  =  iQ)  <  »,  and 


o2  =  (Y^^)2|X0  =  ifl)  <  ®.  then  as  t 


P(Z.  (t)  <  x(tir  B"1)^,  Z,(t)  -  tB_1(E  U-E  IV)  <y(tir  B*1)^) 
0  z  0 


P(a  sup  (Z  (t))sx,  o,(pZl(l)*£?  Z,(l))-o.  sup  (Z.(t))iy) 
0<t<l  1  2  1  2  ^stsl  1 


where  Z^* ) ,  Z2(*)  are  independent  standard  Brownian  motion  processes, 
”1  -  Et  'Vu-'i>2|X0  *  *0> ' •  S*J  P  -  «’1o2)'1Etv'»Y<!>  IX0  =  i0)  . 


PROOF.  From  (3.5),  we  can  show  that 


Z«(t)  *  *  wax  (~S .  +  “  max  ^  • 

2  Mlt-)  0<j<k<M(t)  3  R  *  OSisMft)  M(tJ  3 


OSj^M(t) 


Again,  from  Tollar  (1985b),  we  have  that  t  max  (-S .  ♦  S.  -  R,  )  -►  0. 

0<j<ki*1(t)  3  k  K 


By  arguments  similar  to  those  of  theorem  2.2,  it  can  be  shown  that  for 


*(t)  «[ir.  B  t] 
l0 


t  *|Z. (t)  -  max 


Uj££(t)  i=j*l 


W  fil  P 
(  l  Y(1,f)|  — >  0, 
•  j.i  u-v  ’ 


>mS& GiSiSti 
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t'^lZ-Ct)  -  tir.  e_1(E  U  -  E  W) 

l  IT  TT 


max 


(r 

i=j+l 


y(i) 

u-v 


)l 


Again,  by  uniform  convergence,  we  can  establish  that 


-^Xt)  v 

lim  PC  max  (  J  Y,,D  £  x(tir.  6  )  *. 

t-*»  l<j<£(t)  i=j  +  l  u  0 


fCD 

u-w 


max 

l<j<£(t) 


( 


W  (i) 

J  YUJ)  <y(tir.  e 
i=j+l  u_v  0 


I 


=  P(Oj  sup  (ZjCtJsx,  a2(pZ1(l)*A7  22(1)1-0!  sup  (ZjCt))^).  □ 


0<t<l 


0<t<l 


THEOREM  If  E_U  »  E.V  =  E_K,  6  <  »,  E[  (Y <**)  2 1 XQ  =  iQ]  <  »,  and 


TT  IT  IT 


then  as  t  -*•<*> 


,*1»^  -  ,  r 


P(Z.  (t)  <  x(tir  6  V.  Z-(t)  £y(ttf.  B  *)*)•—►  P(0.  sup  (Z  (t))  £ 
1  l0  0  xO<t£l 


[sup  (a  (pZ.(t)  ♦  /l-p2  Z  (t))  +  o.Z  (s))  -  a  sup  (Z. (t))]sy) , 
0«t<sll  L  1  1  xO<t<l 


2  2 

where  Zj(*)>  c^,  a and  p  are  as  in  theorem  3.2. 


PROOF.  As  in  theorem  2.3,  it  can  be  established  that 


~k  (i)  P 

t  ^(Z  (t )  -  max  (  t  Yn  — *■  °» 

1  l<j<£(t)  i=j+l  U_V 

k  ,(i)  .  ^^(i). 


-£(t)  p 


and  t  *<Z2<t)  -  max  (  £  Y<*  '  +  £  Y  ^)  +  «ax  <  I  Y  )) 

2  l<i<k<£(t)  i=i+l  U  V  i=k+l  V  W  i=j+l  U 


Again  by  the  i.i.d.  nature  of  {(Y^^,  Y^^)},  we  have  that 


lit)  ,.s  J, 

lim  P(  max  (  £  Y'  )ixU( t))  2, 
t-*»  l<js£(t)  i=2  u_v 


®ax  (  l  Yv-i  + 

l*jsks£(t)  i=2 


max  (I  Y^>)<y(£(t))2) 
l<j<£(t)  i=2  u  v 


=  P(a  sup  (Z  (t)  £ x, 

0<t<l 

C  sup  (o.(pZ.(t)  + /l-p2  Z.(t)) +a  Z  (s)) -a  sup  (Z  (t))]£y).  □ 

0<t<s<l  21  2  Ostsl 

It  should  be  pointed  out  that  the  Brownian  motion  function  expressions  of 
theorems  2.2  and  2.3  can  be  expressed  in  an  integral  form  instead  of  the 
form  given.  However,  the  expression  of  theorem  2.4  seems  not  to  have  a 
form  simpler  than  given. 


In  the  next  section,  we  examine  the  four  cases  in  which  one  compart¬ 


ment  is  subcritical,  and  the  other  is  either  critical  or  supercritical. 

3.  ONE  COMPARTMENT  SUBCRITICAL. 

Again,  there  are  four  separate  cases  to  be  considered.  In  all  four 
cases,  it  will  be  shown  that  the  subcritical  compartment  is  asymptotically 
independent  of  the  suitably  normalized  critical  or  supercritical  compart¬ 
ment.  The  marginal  behavior  of  the  two  compartments  then  completes  the 
results . 

The  independence  is  established  by  appealing  to  theorem  5.2  of  Puri 
and  Tollar  (1985),  which  essentially  states  that  for  two  processes  Z(t) 
and  Y(t)  where 

a)  for  each  c  >  0  there  is  a  x>0,  a  T>0,  and  a  process 
ZT(t)  where  for  t>T,  P(|Z  (t)  -  Z(t)  I  >  e)  <  e, 

_j*  P  T 

b)  t  *(Y(t-x)  -  Y(t) ) — i-O,  (3.1) 

c)  Y(t-x)  and  Z  (t)  are  conditionally  independent 
glVen  XM(t-x)+l?  TM(t-x)+l’ 

r 

then 

lim  P(Z(t)  Sx,  Y(t)  SyA  =  lim  P(Z(t)  <x)lim  P(Y(t)  Syt%>  (3.2) 

t-x»  -f-xo  "t-xa 

Lemma  5.1  of  Puri  and  Tollar  (1985)  observes  that  for  Z(t)  of  the  form, 

H(t)  :  ■  •  M(t) 

Z(t)  =  maxCZ  +  l  U.(X.),  max  (  j[  U.(X.))]  (3.3) 

i=l  1  A  l^JSM(t)  i=j+l  1  1 
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where  E^U  <  0,  then 

M(t) 

Z  (t)  =  max  (  l  U.(X.)) 
M(t-x)<j<M(t)  i= j+1 


will  have  the  property  of  (3.1a). 

In  the  following  theorems  we  define  for  -  <*>  <  y  <  » , 


$(y)  =  (2ir)“  *exp(-u2/2)du, 

and 


(3.4) 


1 I  (y )  =  T2$(y)  -l]I(yS0). 

THEOREM  3.1.  If  EwU<EffV,  E^E^W,  B<«,  a*  =  E[(Y^)2iX0  =  iQ)  <-» 
then  for  all  continuity  points  x  of  P(Z^  ix), 

lim  P(Z1(t)<x,  Z2(t)  -  t(E7rU-ETrW)B~1  SyCoJti^  e"1]*) 

=  P(ZX  £x)*(y), 

where  is  a  random  variable  such  that  P( |Z^ I  < “) = 1. 

PROOF.  From  (1.5),  since  E_(U-V)  <0,  it  is  clear  that  Z,  (t)  is  of  the 

-  IT  1 

desired  form  of  (3.3).  From  Puri  and  Tollar  (1985),  Z^(t)  — ►  Z^,  and 
there  exists  a  Z  (t)  of  the  form  (3.4). 

T 

From  (1.5),  we  have  that 


20 


i-V 

m 


Kv/ 


Z2(t)  =  ^(t) +max[Zl,0  + Z2,0’  Zl»0  +  1;£Tax  (Sk'Rk) 


j-M(t ) 


max  (S,  -  S .  -R,)3-Z(t). 


Since  E7rW-£^U<0,  E^V-E^VcO,  we  have  from  Tollar  (1985a)  that  as  t 


maxCZ  +  Z  ,  Z  +  max  (S.-R,  ),  max  (-S .-S ,-R,  )]+Z  <“  a.s. 

i,°  2,0  1,0  lsksM(t)  k  >  lija!SM(t)  o  k  Tt 


Therefore,  as  t->“ 


t  [Z_(t )  -  P-,,  ,  3  •+  0, 


J2  “M(t) 


Let 


As  established  in  Puri  and  Tollar  (1985),  for  any  fixed  x. 


t  ^RM(t)  “  RH(t-x)^  *“  °* 


As  such,  it  is  clear  that  Y(t)  fulfills  (3.1b).  It  is  equally  clear  from 


the  strong  Markov  property  that  (3.1c)  is  met  by  Z^(t)  and  Y(t-x).  As  such. 


since 


lim  P(RM(tj  -  t(EwU  -  E^B-1 <y[oZtni  g"1]^)  =  $(y) 
t-**>  0 


(see  Puri  and  Woolford  (1981)),  (3.1)  completes  the  theorem  □ 


The  proofs  of  the  subsequent  theorems  will  be  essentially  the  same  as 
the  previous  theorem.  It  will  be  sho--m  that  the  subcritieal  compartment 
is  asymptotically  equivalent  to  a  form  like  (3.3).  Therefore  a  Z  tti  will 
exist.  Y(t-t)  will  be  essentially  the  supercritical  or  critical  compart¬ 
ment,  therefore  (3.1)  will  be  satisfied.  The  arguments  of  Puri  and  Tollar 
(1985)  give  us  the  marginal  behavior  of  the  subcritieal  compartment,  and 
arguments  entirely  analagous  to  the  discrete  time  arguments  of  Tollar 
(1985b)  can  be  extended  as  was  done  in  theorem  2.2  to  deal  with  the  con¬ 
tinuous  time  behavior  of  the  critical  or  supercritical  compartment.  As 
such,  in  the  following  theorems,  we  will  only  show  that  the  subcritieal 
cell  can  be  reduced  to  the  form  of  (3.3),  then  simply  state  the  desired 
Y(t)  and  its  convergence  properties. 

THEOREM  3.2.  If  E  U  <  E  V,  E  U=  E  W,  P  <°°,  Ef  (Y(1 )  )2  |X_  =  i.  )  < 

-  -  7T  7T  TT  7T  U~V  0  0 

then  for  all  continuity  points  x  of  P(Z^Sx), 

lim  P(Z  (t )  £x,  Z  (t)  ^y(0^t7r  B~1)'*)  =  P(Z  <  x)  |3> I  (y ) , 

t-K»  X  *  1  0  1 

2  (  1  )  2 

where  cr,  =E(YV  ')  |X„  =  i„ ) . 

-  1  u-w  0  0 

PROOF .  Since  Z^(t)  is  clearly  of  the  form  (3.3),  letting 

Y(t)  =  max  (S, -S.+R„/  .-R,  ), 

0<jlk<M(t)  K  3  k 


by  arguments  identical  to  the  discrete  time  arguments  of  Tollar  (1985b) 
it  can  be  shown  that 


t”*CY(t) 


max 


0<k<M(t) 


(Vt)-\)J->0’ 


and  from  Puri  and  Woolford  (1981),  it  follows  that 


lim  P(Z  (t)  £y<0*tm.  g"1)’*)  =  |*|(y).  □ 

t-*®  1  "0 


~  ( i  \  <■/ 

THEOREM  3.3.  If  E  U  =  E  V,  E  V  <  E  W,  g  <»,  E[(Y^'riX„  =  i„)  <®,  then  for 

- — —  -  TT  7T  IT  TT  U~V  0  (J  - 

all  continuity  points  y  of  P(Z^  < y) , 


lim  P(Z  (t)  £x(n.  Z  (t)  <y)  =  !<M(x)P(Z  <y), 

t-*»  1  10  1  i 


where  =  EC(Y^^)2  I 


W' 


PROOF.  Let  Y(t)  =  max  (S 
~~  0<j<M(t) 


M(t) 


-  S^). 


ments  as  in  Puri  and  Tollar  (1985)  that 
have  from  Puri  and  Woolford  (1981)  that 


It  can  be  shown  by  renewal  argu- 


P 

t  ,!(Y(t )  -  Y(  t-T  ) ) — ►  0,  and  we 


lim  P(Z.(t)  <x(m.  c?e_1t)?5)  =  M(x). 


lirr.  P(A(t)  )  =  1 

■f->OD 


(3.7) 


•t 
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Also,  from  lemma  5.1  of  Puri  and  Tollar  (1985),  it  follows  for  all  £>0, 
there  is  a  and  a  T0  where  for  all  t  >  ,  t  >  , 

P(B  (t)) >  1  -  e  (3.8) 

T 


To  examine  CT(t),  we  observe  from  Puri  and  Woolford  (1981),  that  for 
6  >  0  such  that  I  <5 1  (  6  )  <  e , 


lim  P(  max  (S„/4,  -  S.)  *  6(ir.  B’^t)**)  =  1  -  |#|(6)  >  1  -  e.  (3.9) 

t-*»  lSjSM(t)  M(t)  j  L0  1 


From  Puri  and  Tollar  (1985)  we  observe  that  for  fixed  t,  as  t -»■<», 


t~2  max 

M(t-T)<j<Jl(t) 


(SM(t) 


-k 

-S,)<tH  l 


i«M(t-T)+l 


l°i(Xi)  '  Vi(Xi)l 


(3.10) 


Therefore , 


P(C  (t) )  £  PC  max  (SM,  ,  -  S  )  £  6(-rr  8~1o^t)'i>  max  (S„,  ,-S.)], 

l<j<M(t)  3  i0  1  M(t-t)<jsM(t)  3 


which,  when  coupled  with  (3.9)  and  (3.10)  yields  that  for  fixed  t. 


lim  P(C  (t)) > 1  -  e.  (3.11) 

t-**  T 

From  (3.7),  (3.8)  and  (3.11),  let  U3  select  a  t  and  a  T  such  that  for 

t  >  T, 
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P(A(t)nB  (t)nC  (t))>l-3e. 

T  T 


Then,  for  tu  e A(t) n  BT(t) n  C^Ct),  we  have  from  (1.5)  and  (3.5)  that 


z2(t)(»)  "»axCZ1>0  *  Z2>0  +  z!,0  t 


max 


l<k<M(t) 


(RM(t)+Sk 


■V’ 


max 


(S, 


l£jSk<M(t) 


Sj+RMC 


max 


l<j<M(t) 


<SH(t)-Sj» 


max 


(S 


L£j£k£M(t) 


M  ( t ) 


max 


(S 


lSj^M(t) 


M(t ) 


-SJ] 


=  maxtZ  +  S  ,  .+  max 

1*°  M(t)  M(t-x)<kSK(t)  M(t)  k 


max  (sMf+v-s.)  +  max  (QMf*>-Q».)^ 

lSjSM(t-T)  M(t)  ]  M(t-T)SkSH(t)  M(t)  k 


'“rfZl,0  +  SM(t)* 


max 


l<jSM(t-t) 


(SM(t)'Sj)3  = 


max 


M(t-x)<k<M(t) 


(WV  =  ZT(t)- 


Therefore,  we  have  that  for  any  e  >  0, 


lim  P(Z  (t)  =  Z  (t))  >  1  -  3e, 

t-KO 


which  from  (3.2)  implies  the  theorem.  □ 
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2  (l)  2 

THEOREM  3.4.  If  E^U  >  EffV,  E^V  <  E^W,  8<»,  and  ^  =  E((Yu  „)  lx0  =  i0)<a>* 
then  for  all  continuity  points  y  of  P(Z^  ^  y) 


lim  P(Z.(t)  -  t6~1(E  U-E  V)  ix(tir. 

1  TT  TT  1A  X 

t-X»  0 


Z2(t)  £y)  =  $(x)P(Z2<y). 


PROOF.  Letting 


Y(t)=SM(t)-t0  (E,U-Vr)» 


it  can  be  easily  established  that  t“*|Y(t)  -  Z^t)! — ►  0,  and  that 

j,  P 

t~a]Y(t-t)  —  Y  ( t )  1  — *■  0. 

Define  ZT(t)  as  in  (3.5). 

As  in  the  proof  of  theorem  3.3,  for  t>0,  t  >  0,  define 


A(t)  =  {u:  Z1>0  +  Z2>0  +  RM(t) * sK(t) < 0}» 


B(t)  =  {u>:  max  (QMn-rQ-5 )  s  max  (QM(t)~Qji )}  » 

T  M(t-x)<j<M(t)  3  lSjSMCt)  3 


C  (t)  =  {uj:  max  (-S.)=  max  (-S.)}. 

T  l£jlM(t)  3  lSjSM(t-T)  3 


Since  E  V  <  E  W,  it  follows  that 

TT  TT 


lim  P(A(t)) = 1. 

t-KO 
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1* 


1 
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By  arguments  identical  to  those  of  theorem  3.3,  we  find  for 


we  A(t)  n  Br(t)  nCT(t), 


Z0(t)(w)=  max  (Q  .  .-Q  )  =  Z  (t)(w), 
2  M(t-r)£j<M(t)  M(t)  3  T 


which  completed  the  proof.  □ 

This  concludes  the  examination  of  the  cases  where  one  compartment  is 
subcritical,  and  the  other  is  either  critical  or  supercritical.  It  is  of 
Interest  to  note  that  when  one  compartment  is  subcritical,  its  limit  be¬ 
havior  does  not  depend  on  whether  the  other  compartment  was  critical  or 
supercritical . 

4.  CONCLUSION 

In  this  two  compartment  model,  eight  cases  have  been  examined.  The 
remaining  case,  where  both  compartments  are  subcritical,  is  left  to  a  sub¬ 
sequent  paper  since  the  present  techniques  seem  to  be  insufficient  to  estab¬ 
lish  the  results.  There  are  of  course  a  variety  of  generalizations  possible 
The  most  obvious  is  to  examine  the  arbitrary  k  compartment  model  in  con¬ 
tinuous  time,  analagous  to  the  discrete  time  behavior  of  Tollar  (1985a,b). 
Clearly,  the  critical  and  supercritical  compartments  pose  no  problem,  and 
results  analagous  to  the  previous  results  will  still  hold.  However,  the 
subcritical  compartments  pose  substantial  problems.  In  the  case  of  exactly 
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one  subcritical  compartment,  results  similar  to  those  of  section  3  can 
be  established.  However,  when  two  or  more  compartments  are  subcritical, 
the  techniques  in  this  paper  do  not  seem  directly  applicable. 

There  are  cf  course  a  myriad  of  other  directions  for  generalization. 

We  will  only  mention  two.  One  that  appears  useful  would  be  to  define  Z^(t) 
and  Z^(t)  in  such  a  way  that  two-way  flow  would  be  allowed,  so  assumption 
(1.3)  could  be  eliminated.  Unfortunately,  two-way  flow  does  not  appear  to 
allow  a  closed  form  expression  for  Z^(t)  and  Z^ft),  so  the  techniques  here 
offer  little  hope  of  success.  Another  area  of  interest  would  be  to  eliminate 
the  assumption  of  moments,  and  determine  limit  behavior  in  this  case.  This 
is  left  for  subsequent  work. 
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